Supporting Real-Time Analysis of Multimedia Communication Sessions1

We have developed a set of interactive tools for collecting, annotating, and analyzing group communication sessions. These tools have been used to model group meetings which we have enacted on our computer-based video conferencing system as well as single location meetings. The purpose of this work is to support the analysis of group meetings over computer-based video conferencing systems. The resulting analysis can be used for various purposes including creating meeting summaries, identifying communication patterns, facilitating group communication, and suggesting agendas for follow-on meetings. The current system is used for off-line annotation and analysis of communication sessions which involve various parallel media tracks including the video and audio component for each participant, the text transcription of the meeting, and various documents and media forms referenced during the session. In this paper we review these tools and describe an architecture for employing these techniques for real-time feedback to a communication session. Real-time feedback could include suggestions for materials and individuals to include in the current meeting, change of topic, and suggesting problem solving strategies.